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1.  objectives 

This  project  develops  a  new  method  for  image  acquisition  and  processing 
that  will  yield  higher  useful  resolution  and  superresolution  capability, 
one  important  issue  in  practical  hardware  implementations  of  passive 
millimeter-wave  imaging  is  the  method  used  to  sample  the  image  plane. 
Ordinarily,  a  focal  plane  sensor  array  has  sensors  placed  in  a  rectangular 
grid  pattern  at  sub-Nyquist  spacing,  and  the  array  must  be  dithered  to 
sample  the  image  plane  at  the  Nyquist  rate  in  each  dimension.  However, 
the  Nyquist  rate  oversamples  the  image  due  to  the  usually  circular 
support  of  the  diffraction-limited  image  spectrum.  Furthermore,  due  to 
the  relatively  large  size  of  the  sensors  compared  to  the  total  array 
size,  boundary  effects  in  the  reconstructed  image  may  be  problematic 
especially  when  the  sample  spacing  near  the  boundaries  is  uniformly  large, 
we  propose  to  develop  efficient  algorithms  for  optimizing  the  dithering 
pattern  so  that  the  image  can  be  reconstructed  as  reliably  as  possible 
from  a  periodic  nonuniform  set  of  samples,  which  can  be  obtained  from  a 
dithered  rectangular-grid  array.  The  optimal  sampling  algorithms  will 
take  into  account  the  frequency  support  of  the  image,  the  finite  array 
size,  and  the  goals  of  high-resolution  reconstruction  and  superresolution. 
Furthermore,  we  will  develop  efficient  reconstruction  algorithms  that 
can  quickly  reconstruct  the  uniformly  sampled  image  from  its  nonuniform 
samples.  The  resulting  methods  will  allow  faster  image  acquisition  as 
well  as  reconstructions  that  contain  less  noise  and  fewer  artifacts  when 
restoring  and  superresolving  the  acquired  images. 


2.  Status  of  Effort 

Our  efforts  have  continued  to  focus  on  computationally  tractable  methods 
for  two  problems  in  the  restoration  of  passive  millimeter  wave  (PMMW) 
imagery  -  unknown  boundaries  and  the  non-stationary  nature  of  images 
containing  edge  structures.  In  both  cases,  the  solution  to  these  problems 
requires  a  tremendous  increase  in  the  computational  burden  compared  to 
FFT  restoration. 

Fast  and  accurate  restorations  that  account  for  these  issues  will  not 
only  result  in  a  better  dithering  pattern  selection  method,  it  can  also 
he  used  to  aid  in  adapting  the  locations  of  sensor  arrays  for  particular 
images.  More  generally,  it  will  also 

result  in  a  more  efficient  and  more  artifact-free  restoration,  since  the 
heart  of  the  computational  issue  is  a  more  tractable  restoration  method 
for  this  structure. 

In  most  restoration  problems,  the  observation  equation  can  be  represented 
or  approximated  by  a  finite-support  point-spread  function  (PSF)  operating 
on  the  original  image  with  additive  noise.  In  such  cases,  the  forward 
model  can  be  represented  by  a  banded-block-Toeplitz  matrix  with  banded 
Toeplitz  blocks  once  we  incorporate  the  fact  that  the  boundaries  are 
unknown,  we  have  developed  a  fast  method  for  solving  such  systems  of 
equations.  The  method  augments  the  system  to  a  block-ci rculant  with 
ci rcul ant-blocks  system  and  then  uses  the  concept  of  generalized  displacement 
rank  to  find  an  LU  decomposition  of  the  augmented  matrix  term  to  solve 
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the  original  problem. 

we  have  shown  that  the  restoration  can  be  decomposed  into  a  sum  of 
two  independent  restorations.  One  restoration  is  based  on  a  modified 
FFT-based  approach  containing  the  usual  boundary  artifacts.  The  other 
restoration  involves  a  set  of  unknowns  whose  number  equals  that  of 
the  unknown  boundary  values  to  correct  the  artifacts  in  the  first 
restoration.  By  summing  the  two,  the  artifacts  are  canceled.  Because 
the  second  restoration  nas  a  significantly  reduced  set  of  unknowns,  it 
can  be  calculated  very  efficiently  even  though  no  circular  convolution 
structure  exists,  we  have  shown  that  an  easily  computed  approximation 
can  be  made  that  often  eliminates  the  need  for  the  second  restoration. 
Where  greater  accuracy  is  needed,  a  few  iterations  of  a  conjugate 
gradients  algorithm  serves  to  eliminate  visual  boundary  artifacts. 

We  have  also  shown  that  the  nonstationary  component  of  a  typical  image  can 
be  separated  so  that  the  restoration  is  decomposed  into  two  restorations 
-  one  being  the  restoration  obtained  by  the  approach  described  in  the 
previous  paragraph  and  the  other  consisting  of  a  single  unknown  for 
each  nonstationary  point  in  the  image.  Because  this  second  restoration 
involves  a  much- reduced  set  of  unknowns,  it  can  be  solved  directly  or 
through  a  much  faster  iterative  procedure. 

The  nonstationary  restoration  approach  has  been  implemented  in  the 
quadratic  case  and  proven  to  work  very  efficiently.  The  method  has 
now  been  extended  to  nonquadratic  penalty  functions  with  great  promise. 

The  nonquadratic  penalty  is  locally  approximated  by  a  quadratic  penalty 
at  each  iteration.  The  quadratic  term  is  identical  except  at  edge 
locations,  and  the  quadratic  algorithm  can  solve  the  approximate 
criterion  exactly  at  each  iteration.  A  proof  of  global  convergence 
has  also  been  derived. 

We  have  developed  a  hierarchical  approach  to  selection  of  the  dithering 
pattern  for  sub-sampled  focal  plan  array  imaging.  The  method  allows  for 
much  faster  optimization  of  the  dithering  pattern.  The  basic  steps  of 
this  algorithm  were  developed  for  an  application  in  magnetic  resonance 
imaging;  the  algorithm  is  being  adapted  to  the  pmmw  problem. 
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